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ABSTBACT 

^ This paper examines how potential conflicts produced 

by e-hhical issues such as confidence and conf id.entiality can affect 
the research methodology of 'educational research and evaluation 
projects. Despite the differences in site selection^ clientel^^ and 
relationship to treatment, both e valuators and researchers must make 
adjustments in nethod to Accommodate ethical concerns* Based on a 
research ^study of the political socialization process of Colombian 
childre&. and several *eduqational program evaluation projects in Hew 
.England, particif)ant 'observation systems are considered for 
»ethodol6gical modificatioh for ethical reasons* In both th^e research 
and evaluation studies, the investigators felt that, the risk of the 
H a nthprne effect or other bia^in^g effects must be subordinated to the 
observed subjects' right ' to know the nature of the observations. In 
addition,^ honoring assurances of confidentiality to one group of 
subjects enhapces the confidence that other groups will have in the* 
investigators' promises. Examples of ethical conflicts that arise 
uniguely in muliclienjtele program evlauations are also described. 
(Author/DE) ^ \ 
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The Questiorrs facin^J^reseanrhar aVid those confronting a program 

evalqatar ^r^cccasioRal V identical, and often similar. There are, ^ 
♦ * ^ • f * 
fe>v;ever, critical- differences between the two processes* A researcher, 

particularly one focusing on hypothesi^ generating iovestlgatlon. Is 

•able to, andMndeed^slSul^ include a Ipde range^of settings and subjects* 

The scope of a program evaluation is soineAliat inore confined; the evaluator' 

HKist focys on a paVticular program in whatever setting that program i^* 

found* A'prcgram evaluator has a client; a researcher may have a funrfer 

or a chairperson or an audienci but usually not, at least at the outset, ' 

a' client. The evaluator my intervene i.n a treatment f>rograin to help 

it accOT^plish.lts objectivesj the research tmist seek to keep a treatment 

program static in order to more 'accurately -study it effects* .These 

differences subtly shapa the form and the degree of the potential conflicts 

and congruencies produced by ethical issues'. such as conTidence and confi- • 

dentiality. This paper focuses on ^hese, differences and similarities 

using an hypothesis generating study conducted in Bogota, Colombia, in 

1970 pts an exajnple"^ research methodology aT/Contrasted with several 

educational progr^am evaluation {Projects corfdiicted in New England in- the 

past tv/o years. 

The primary purpose of the research study was^to gather data that ^ 
would be useful in generating hypotheses on the" political i50ciali?ation 
of Colombian children. The focus of the research v/as to determine the 
perceptions that elementary '•antfe junior higfi school students in different 
school and socio-economic environments in a large Latin American city 



had regarding their countr'y ard tr;3 rples citizeQS play In its ^overnrent. * 

Students at H schools participated in the research effort, (fee 
hufKired and sixteen^Ksre personally inter/iewed and 1^32 others answered ^ r 
a written questionnaire. ,Data were gathered on political attitudes, feelings 
of social trfist, an(t children's wtemal versus- external locus of control ^ 
orientations. The relationships ar^ng the .variables were exaaifted froni three 
different theoretical perspectives; an. envirori^ental approach that emphasized 
deTTcgraphic varrables, deyeloj>:r:ental theory which focused on age and grade 
levely^and a syst^eras- iBalntenance orientation th^t'dealt with schools* 
efforts to prdT'Ote'ajttit^^des consistent with the, conti laiatioh -of the ^present 
political System. . ^ * . • . ' " 

I^. was ho^d that, the data would contain evidence jthat might indicate 
whether the political socialization process^-fh Gol-ombiavis similat to' tteit 
* reported* in, the United Siates or v/hether conclusions drawn from United 

Strtes data are^ iha^jpropriate in oth^r settings. / 

' . ' ** * . . ' ' ' ' 

A methodological concern af the research, study involved a'comparison 
of personal interview? ?nd, wri^tten questionnaires irt gathering data on the 
political socialization of children. , . . . 

* . Studerjts in classes corresponding t6 AneJ'jcan 3rd, 5th, 6th,' and 
7th grades jin 14 Colombian schools were tfsed. • The schools were purposively 
selected on the ^as-is^ of socio-economic background of the students attending 
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ar*d the t^^e of sch:>ol, either ^>iib1ic. or private* Because the purpose 

/ v^s to generate hypotheses for future study, an effort was rade to include 

scf.<^&3s that v.ere, thought to be representative of large fiinnbsrs. of Colonibian 

schools as. h-ell .as ones that ap^gared sorrewhat uhiqu? wl.thin the educattonaV 

frgjnew'ork. The use of r^ny schoots rather than a select^l^f was costly 

in tenns of ix)th time andTJoHey, but tl^^e resulting data vs'ere full of the 

contradictions aixJ surprises that help a researcher resnape initial assump- 

tions and fon^ulate positions for further investigation* 

*^ 

Site selection and number of sites aire not always options for educational* 

program evaluators to explore, rather the prpgratn and the locations in which • 

«. * - 

* > ^ 

it is to be studied are usually predetermined, often long before the evaluator 
Is brought on the scene. The extr'emes'of fhis situation are exejjplified 
by single classroom, innovative pnograros.for which it -is oftea iJnpossible 
to find a coniparison group and systc^n-wide programs forHhe educationally 
disadvantaged that require' the evaluator. to gather d^at^ from virttfaTly^^very 
c^lassroom in every building of a city-wide school system. 

Evaluates often desion data gathering techniques^ based on the require- 
ments of the clients rather than on theoretical considerations geared, to 
the ^'generation of hypoth^es. Hov.eve/, in the constructionC^f^sts, question- 
naires, and other instruments; both researchers and evaluators are usually 
able to refer to items used in previous investigations*^ 

Hov;ever,^ research-in different cultural -settings may be limited by 
the fact that previous investigations have alT been co/]ducted in the United . 
^States. This is particularly true in the area of childhood political 
socialization, and the researcher found that many of the. items used in 
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previoas stadias Kfera oriented to Ar*er1can children in a United States 
setting. Wnen results were obtained overseas that parallel those of the 
U^S. studies,. it is often assured that the children and/or the processes are the 
sane but it is e.ntirely possible that. what is mre to the point is that 



the questions themselves nere inappropriate for that setting* 

For exainple, both .U.S. and^Colo^bian* children might respond "Yes" to . 
a question such as "Does it make you feel p.r&ud to see the flag of your 
country?" Hovever, the differences in symbolic uses^of the fla^s in the 



th-o countries would sugg^.st that the responses nsight have very different 
meanings.'' ' 

The use of personal interviev.'s in the Colofnbian research study was 
intended to pennit an examination on this Inherent bias. The interview, 
therefore^ served as a means of validating sc^ne of the questionnaire items* 
by giving a clearer picture of how students uncfers^ood and interpreted 
specific questions.. The interview schedule contained a -selection of the 
.st-udent questionnaire items^ follov/ed by probes such as^hy or what . Its 
use af^ expanded the researcher's understanding of the responses obtained 
on the v/ritt*ln questionnaire because it^was more loosely structured and 
concentrated oft in-depth .responses,' With young children, it is difficult 
to know v/hether one is testing an attitude or creating one» .A political 
socialization questionnaire may confront children v/ith issdes they have 
ne^er before considered and they may hastily select one response. More 
carefully questionned, the children may reveal that they have no .strong 
feelings on the subject. * , 
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Personal interviews cire. also a frequently used tool in educatix)nal 



- ■ \- 

program evaluatioDS with subjects being children, teachers, adcilnistratars, 
parents, or others. Si'ncer it is unWkely that a program evaluator^htiuld 
need to drav^on experiences gained in a different cultur^r^heM^o of 
difficulty discussed above is unlikelyT?) occur. fJevertheless, pei^sonal 
tntervfews' serve-a ^a^tjsbfe func t io n in the va l idatf on-of.^e^htetTon - - 
questionnaires. All too often, *tiie technique is not eniployed duejto^ 
budgetary linitations. In a recenjt evaluatiorl of a compensatory gducati'on 
program, the evaluator was unable to devote the time md money n^essary 
to conduct personal interviews as a follow-up to a teacher questionnaire , 
concerning the value of -a suppleiTtentary administrative program.. As part 
^of. the school system's ^valuation process, every program evaluation was 
audtted by another evaluator. In this. case, the second evaluator used 



his resources to do fcllo^v-up interviev/s* Since teachers had responded 
anonymously, it w^^-4«jiMsible to ask about specific responses that had 
been given to the questionnaire items. The auditor ititerv/ey/ed a ^mall 
numbeV of teachers and found that most of them did not remember having 
filled out the questionnaire at alK 'For some of the it^is on* the ques- 
tionnaire, the responses given by those who did remembe/ cofiipleting the 
questionnaire v/ere inconsistent v/ith the data reportec^^by the evaluatoi^. 
Unfortunately, there was no v/ay of assuring that the /auditor and the 
evaluator were basing their conclusions on data from the same set of • 
subjects. The resulting confusion would no doubt have been avoided had 
the resources been available for proper validation of the questionnaire . 
results by the evaluator. The use of personal /interview data raises 
one of the central issues addressed in this paper — how honest are 
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respondents going to be if tbay'feej their. replies teay be shared wnth ^ ' 
ot^hers in ways vrhlch vrodltf^leave litt^ doubt as^to *the.re§|5onderfts • 
identity? In the case of the research study reji^rted- tiere^ the d^ision^ 
was inade to assure respondents of the conf id^ntiaji^y of their responses • 

to *bin1d into the design of the stutfy ars tnariy '^uarante^ of ^nonymty . 
as possible. ' — - *i • 

In administering -the questionnairesr during- the Colonibian field ^'ork, 
the researcher and her assistants intrbdacedvthemselves to the class and 
explained that they \fere interested in learning more about how children 
felt about , certain things. They explained that the paper and pencil 
questionnaire was not a test and that no one at the school would see their 
papers. Jhg^studeo^s v /ere asked not tojDut their names on the questionnaires 
unless they wanted to^do so. The researchers then asked if. there vs^re any 
questions and answered those that did- not concern the. specific ^nature of the 
questionnaire items. 

The personal interview procedures v/ere- e^cplained and those* students 
who v/ished to be interviev/ed were asked ,to put their names on pieces of 
paper which were then drawn from a hat. The children selected for the inter- 
View were taken to a private room and interviewed individually. * 

After the interviewees had left the room, the v/ritten questionnaires 
v/ere distributed. The children v/ere reminded again that it v/a? hot a test, 
that no one at the school v/ould see it, and that they need not put their 
names on the papers. They v/ere cautioned to aasv/ei^ individually and to 
leave blank any questions that they preferred not to ansv/er. 7 

. Students were assured of the confidentiality *of their responses in 

r 

; ^ 
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^ order to tnaximize the honesty of their replies and to' reinforce the point 
that* survey instruinents.Were not tests. .Tea-chers and administrators at all 
of the schools v;ere^very interested in the research and despite the repeated 
explanations that student questionnaire^^ were^^onfidentlal, sevetal assiiHied 



that they v;oul-d be all^w^d ix> review sjudelit r-esponses* The researcher* s 
insistence that this v^uld not be possible caused an occasional ruffled 
feather, but had long range ben^fits^n that it reinforced the -other 
guarantees of confidentiality that *nad been given* 

ForjBxample, school administrators had^een assured that no school 
hwld be referred to by name and that no data on students at a' specific 
school would be released to anyone other than persons specifically approved 
/^by the school 'director. This assurance v/as kept despite requests from 
various agencies for data beyond that contained in the final report. This 
assurance was particularly important in obtaining the cooperation of 
. school staff people on tv/o of the data gathering instruments that dealt 
with school milieu' and teacher attitudes^ 
/ A school daia sheet' v/as used to record descriptive information about 

..the school and also to record the researchers impressions, of the general 

/ ^ classroom atmosphere and the .educational^ phildsq^^y pr^l^nt v/fthin 

It's,' ;*j ^' 

school. This data was collected informal'^JUrfng the researcher*s 
' '7 initial visit to the school and^o^T^ubsequent visits v/hen stujdents were 
' being interviewed. Although observational data collecljed v/hen subjects 
are unav/are of the collection process may be a more valid reflection of 

7 - . 

daily routine, the resentment that may be engendered in^this way is seldom 
v/orth the effort. School officials wer6 shov/n the instrument and no 




:itioiisly. ^ ' 



attempt v;as made to collect data siirrepti 

Along with the practical^ consideration leading the researcher to 

a decision favoring openness, ethical issues also required that a full 

• explanation te given to school officials, teachers, ^nd students* • 

^ i^es ga r ch ers working overseas are free of many of the legislattvere-^ - 
■\ - ' ^ . ' • 

" str^ctions facing investigators working i^n American schools, but the 

added -information one can obtain seems relativfely valueless when con- 



trasted v/ith the ultimate distrust that may result. In program evalua- . 
tions, it is often possilJIe to avoid creating distrust by getting permis- 
sion, .in advance, to make unannounced visits and to conduct both structured 
and unstructured classroom observations. Occasionally, however., the v 
s&ftsitivities of program staff may require that all observations be 
announced and structured and that the^varfable's to be observed be made 
known in advance.* In one such program, the evaluator found it necessary 
to show the observation form at. nearly ?very vi'sit and to discuss the 
results afterv/ards. 'While this procedure limits the use of the data for 
judgments concerning a program's success, it may serve as a feedback 
source for program improvement, " . 

It may v/ell be that" the ways in vihich bbServational techniques ^ 
are used in both evaluation and r^esparch are the clearest examples of 
methodology being shaped^to meet the ethical requirements of the situation. 

The Colombian study v/as designed to generate hypotheses and the 
analyses concentrated on a description of the data and the relationships 
among the variables, .As had been hoped,' the data revealed several avenues 
for further study and generated hypotheses that future researchers might 



investigate. . Especially i n teres ting-^wa^ the indication ^that the type of 

system-supported socialization that many American resear^Jiers have, 

attributed to- public scf^ools may be carriec} lout 'n'n Bogota by private 

institutions. The social trust data also hinted at a possfSle "coolout" 

• * 

of lower class children. Many of these chilflren appeared to have felt 
more trusting and less efficacious than did higher status children. Given 
the socio-political structure of Colomtiia, this finding was particularly 
interesting. 

, A comparison of interview data with questionnaire respon$6s indicated 
that the pattern of responses was J>asically the same. Thp'^interviews 
therefore proved a valuable validation check on the questionnaire items,, 
since it was usually obvious in the irvtej>*^s if a child had- misunderstood 
or misinterpreted a question. The investigator concluded that individual 
irfter\?iev/5 are a necessary ppirt of the-' investigative process bul that they 
are most lisefut at tJie pff%test stage./ It is there that one can make the 
best use of a child ^s level of understanding and of the transitions that 
she/he is able to make between items. * Items that are confusing to students 
are revealed early in the program. 

Future tross cultural researchers on political socialization mi^t 
do well to conduct a serie? of tape recorded group interviews initially 
nd to follow t^ese up with some random interviews that concentrate on 
;the child's level of understanding of questionnaire ftems. Group inter- 
viev/s would enable the investigator to gather opinions from more children 
in less time than v/ould individual interviews, follow-up interviews with 
individual children would assure the researcher. that the questl^ris were 



understandable and meaningful .fo^j:hildren even without group support* 
A questianlaire containing^some open-ended items and constructed on the 
basis of this type of preliminary .investigation \Wuld appear to be a - 
reliable instrument for gathering political socialization data from even ' 
young children/ * * . " i ' ' — — 



ThQ fact that an educational program evaluator seldom has a singile 
.^lll^lient or even a single group of clients leads to some unique cjashesjof 
ethics^and methodology not likely to be found in a'research study. For^ 
exanipler^to^the extent that the needs or expectations ^f various client' 
groups conflict with one another^ the evaluator is likely to experience 
some confidence/confidentiality ro4e conflicts. To assure some consistency 
in tefminoTogy, v/e are using confidence to^ refer to those situations in 
which an investigator must establish to a client that she/he is worthy 
of trust. We are using confidentiality toVefer to th e occasions that 
require the investigator to assure that Information received, v/i 11 be kept 
private. 

FqV example, suppose that a hypothetical principal's association 

has contracted for an external evaluation of an innovative school 

administration project. Suppose further that the evaluation design ^ 

» ^ 

involved, among other things/ interviews with the principals and reviews 

of administrative documents including budgets. It is hard to imagine 

«' ✓ . . • * ' • 

a better example of an evaluation study with few client groups. On the 

surface, it appearS^^tljat only the principal's association is a client, 

and it seems* likely that assWipg^^the principal? that all evaluation data 

will remain confidential is a sure method of winning their- confiijence. 
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But even in the hypothetical world the school system' is 'governedL by a 

school comnlttee or board of education whose m^nbers will* regard thenj- 
c • 

selves as Jthe evaluator^s clients^and whose concern with fiscal matters 

may render juch 4n assurance of confidentiality impossible. Furthennore, 

v/ithin the principal,s' group,. some individuals may feel very strongly - 

that interview summaries shoilffd be made public to insur6 that each 
* ■• * ' 

principal is accountable for the position he takes* It wuld then be 
incumbent upon the evaluator to determine whicb data ought to be confi- 
dential, which public, and why. It seems apparent that the decision, ho 
matter what it may bej will^have a cost in the form of reduced confidence * 
on the part of some portion of \he clientele. If, for example, the 
evaluator proposes to conduct and release a financial audit, the 
principals may feel con^allBd to conceal from the evaluator some instances 
in which supplementary federal funds have been used to suppUtit local funds. 
Moreover, while the principals may be held accountable for publicly expressed 
pVsitions, the data obtained in non-confidential interviews may not 
accurately reflect the principals' honest appraisals of the innovative pro- 
gram (that is, the evaluator has lost the principals' confidence). 

. ^ In a situation roughly , similar to the one described- above, the 
evaluator reported th^t 75% of. a group^ of administrators had returned a 
confidential questionnaire. Their supervisor v/ahted a T()0% return and 
requested the names of the respondents. Since the cover letter the ques- • 
tionnaire clearly stated that the responses v/ould be kept confidential; 
the supervisor's request was denied* The 'supervisor then demanded the 
names of non-respon3ents saying that the cover letter 'did riat promise "that* 
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non-responses -fa-ould be kppt confidential.* Of course, the end result v.'ould 
have been the sane; therefore, the information was not provided! -Subse- 
quent cover letters were modified to state "that **1ndividua1 responses would 
be* kept confidential, but a list of respondents would be provided** to the 
. supervisor. 

This example is not representative of the majority of program eyalua- 
tions. Administrators are usually only one of many client groups • Others * 
include teachers, counselors, parents, students, funding agencies, the 
general public. Of the lot, administrators seem most able ta understand 
and appreciate the probl^s of evaluation. The evaluator's contacts with, 

* most of the others are less frequent ^nd ntore formal (i.e., through 
structured interviews, questionnaires, group meetings, etc.), except 
for teachers in circumstances that require extensive observation* 

The average classroom teacher has had three experiences that she/he 
associates with the word evaluation: ^ required college course (or courses) 
that emphasized statistics,, the recurring responsibility to give^rades^ 
to students^ and the ^an^iyal 15-minute classroom observation upon which the 

' principal bases her/his decisions about the teacher's professional per- 
formance. For'mdst teachers, all three 'are unpleasant and there seems to 
be considerabl^ptransfer of their negative reactions from these situatiqns 

- to program evaluations. - . * ' ^ 

. To earn the^confidenfe of teachers, a' program evaluator must first 
c.lear up two common misconceptions. She/he must assure the teacher that ■ 
she/he is not involved in personnel -evaluation, and she/^e must clearly 
indicate that, the students' right to confidentiality may require that- 
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- ti« evaluat^n data be reported vn a group basis only* The latter is 
• necessary for'^t least two reasons: Ij because it will increase the 
• probability of dt>ta1m?.g' honest student responses, and 2) because it will 
prevent the ysX^ gr<^p-t est* data for individual diagnosis (a purpose 
for >rf^ich it was, not intended). An additional benefit is similar to the. 
^ one refeh^ed to the research exapple: teachers seeing students* confi- 

*dence respected will know that assurances given to teacters will be like- 
wise respected* In the Colon^ian research project, the overall return 
rate for. teacher questionnaires was 77% with no school returning fev^'er 
, • than 50?;. In a study of political attitudes and in the face of some • 
I administrative opposition, these returns were a welconie "vote of confidence." 

Once these fundamentals, have been established, the evaluator can 
sqore confidence points by speaking freely of her/his own teaching experi- 

I 

ence, by separating personal from professional opinion, by explaining the 
rationale^for evaluation activities, and by being available as a resource 
person and hand-holder. Also, the evaluator *s>evealibg that she/he ^ 
possesses a sense of hunor can go a long way tov/ard winning the' confidence 
of crtiy client group. * * * . ' . ^ 

Some teachers may hava had prior experience with program evalu|^on, ^ 
so the groundwork may have already been laid. In this case, all' that may 
-be needed to gain^he teachers' confidence is to respect their confidential- 
ity and remain objective. On the other hand, the teachers' prior 'experience 
. may have been unpleasant.^ One of the 'writers evaluated a compensatory 
kindergarten ^program that used operant conditioning procedures t9 teach a * 
highly academic curriculum. The previous^eva1>uator ha4 relied on a small 
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highly acadenic curriculum. Tte prevj^ous evaluator bad relied <)n a sniall 

nuf:ber of unstructured classrocri observations and concluded ttiat the 

teaching staff lacked creativity, was unprofessional, arid could not survive 

in a n&gular school progran. When the vritea^ was introduced to the 

teachers, tv.'O made distasteful conrtents, one, turned and walked away, and , 

the rest v.'ere painfully polite. In order to win the confidence of this 

staff it was necessary to: 1) announce all visits in advance, 2) be 

accoripanied by the project director on several visits, 3) show the teacher 

the observation schedules being used (what Hawthorne effect?), 4) provide 

teachers with copies of all evaluation reports, and 5) avoid identifying 

^ the teacher or classroom on observation records. 

^ Special problems occur when parents are a target group for project 

activities. Project staff involved in home visits may nof want to risk 

the confidence and trust they^have earned by having an evaluator accanpany 

* 

them. Militant. parents* groups may demand the release of names of teachers 
who are not implemejjting the program. -Individual parents may request 
infomation about their child's test performance, like teachers, parents 
may have nflsconceptions about the evalirator's role. In conducting interviews 
in a school administration building, one , of the writers found that appfpxi- 
.y mately or- '^rent in four came in expecting to hear bad news. about their 
child. T . vas alarming only Because parents had been sent a letter 
explaining ^ne interview and had also been gi<ren further explanation in tv!0^ 

telephone callsl - < • 

^ .. ■ « 

To win the confidence of parents, an evaluator must be sensitive to 

the parents' views of education. Some parents still hold educators in high 
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regard. Cnce they know the e^.-aluator's credentials, especially if she/he 
has been a teacher ar^/or holj*s-a doctorate, tbsse parentSiFiay exhibit a 
.level of confidence that approaches reverence (too such contact with^^^this 
type of parent ray cause one to take her/hinself seriously). At the other 
end of the parental spectrum are a good many fonr.er revolutionaries whose 
general distrust of authority has been focused on the educational systeai<. 
Such parents rnay adopt the arttitude that evaluators are co-conspirators 
in a great educational swindle that seeks to conceal teachers* inability 
to give their children basic skills or good feelings about thenselves or 
whatever. Although these parents may initial ly^em to be an obstacle to 
good evaluation, they can prove to be a most valuable asset. If the 
evaluator will take the time to get to know the leadership personally, the 
parents v/ill point to specific areas of program operation that^thers 
them, they v/ill ask questions about differences in implenent^tion, and they 
will identify the program activi4;ies that please them. IL-X^ evaluator 
vdll then frake an. honest effort to collect objective data re|^rding areas 

of parent concern, there is a good chance that he will have e^ned their 

' ^' ' ' i - ' 

confidence (though they'll nevfer admit it) even if the datar not support 

the parents^ position . One iflred only to review the materials published .by 

the United Bronx Pffrents to see how valuable parental input can be to the 

, conscientious evaTvator. • ... " V 

. A/ar less tangible client for educational evaluations is \the. 

community." Sometimes the evaluator may know the area he is worki>3g in 

well €?nough to have formed a conception of the community and to havd 

for^nuJsted ideas about its expectations of .Kim. Many times, hov/ever, the. 
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evaluator is an "outsider* whose conception of the conrminity is fomed by 
the school staff she/he Is evaJuatidg* Haturally, this nay prove to» be 
an unde'sirabl-e situation (ypless the evaluation design is goal free)* For 
exaciple, in evaluating a low-budgeted innovative kindfergarten program, one 
of the authors found it necessary to spend an inordinate kmount of time and 
energy obtaining permission to test or interview students. T-he principal 
finally disclosed the reason; the project employed a consulting clinical 
psychologist who had grown up in the neighborhood served by the school; he 
was engaged in intelligence and {Projective pers(3i\ality testing of a. highly 
confidential natlTre. Since parents and others in the community knew him 
"and the nature of his testing; the principal feared that the community would 
not tolerate revealing such information to^"an outsider from the University, 
nor would they understand the d tf farejices^ in the'-ki*nds of testing involved. 

In the second year of that project,- the 'same^ evaluator -knew tlie community 

• '/ • - • 

better and vice versa, so the testing was Titore easily arranged. 

• •■- . 1 

- Although additional examples of^the impfact of ethical issues on 
methodological questions could be cited, endugh have been given to make the 
point. To summarize briefly, this' paper bigan by. noting some contrasts be-- 
tween educational research and progwiri evaluation. Despite the d'ifferences 
in site selection, clientele^ and relationship to treatment,* both evaluators 
and researchers must make adjustments in method to ac.coiiinodate ethical 
concerns. The use of persona^l interviews as a questionnaire validation . 
procedure was discussed. It was noted that, the annoymity of questionnaire 
responses. Observational systems were gl So consfjder^d to be especially 
stisceptible to modification for ethical reasons. 'In both research and. 
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evaluation studies,- the investigators felt that the risk of Hawthorne or 
other biasing effects fsjst be subordinated 'to the .right of those being 
observed to know the nature of the observations. 

Dealing more specifically with matters of confidence and tonfidential- 
ity, both the researcher and the evaluator found that honoring assurances of 
confidentiality given, to orie group of subjects enhances the confidence 'that 
other groups wilt have in the iwesti gator's, promises. 

Finally, some consideration v.'as given tP examples of ethical cortflicts 
that. arise uniquely in multi-clientele program evaluations, Oiscussion\^f 
the examples led'to specific reconmendations for similar situations. 
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